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METHOD FOR A MOSAIC PROGRAM GUIDE 



The present invention relates to the field of digital television; more specifically, it 
relates to a method for generating a mosaic program guide for digital television. 



presented in windows on a display device such as a video monitor. Each video frame is 



derived from a different program, and only one video frame is displayed in each window. 
Generally, the video frame within each window is refreshed at some periodic rate. 
Mosaic program guides help viewers to preview and navigate through the numerous 

10 programs transmitted by digital television systems. However, providing mosaic program 
guides is costly and time consuming. One technique for generating a mosaic program 
guide requires simultaneous video decoding and presentation of multiple programs in 
multiple windows. This technique requires very fast and expensive equipment. Another 
technique for generating a mosaic program guide requires a service provider to generate a 

15 mosaic guide and then deliver the mosaic program guide as a single program that appears 
to be broken into windows. This places additional cost on the service provider in terms of 
equipment and human resources as well as using up bandwidth that could otherwise be 
used for programs. When several hundred programs are available, this is not a trivial 
undertaking on the service providers part. 

2 0 Therefore, there is a need for a method of generating a mosaic program guide with 

minimum additional cost. 

A first aspect of the present invention is a method of generating a mosaic program 
guide comprising; generating I frames from a coded video bit stream; placing each I frame 
into one of a multiplicity of mosaic windows; and combining the multiplicity of mosaic 

2 5 windows into a mosaic video frame. 

A second aspect of the present invention is an apparatus for generating a mosaic 
program guide comprising: means for generating I frames from a coded video bit stream; 
means for placing each I frame into one of a multiplicity of mosaic windows; and means 
for combining the multiplicity of mosaic windows into a mosaic video frame. 

3 0 A third aspect of the present invention is a receiver for generating a mosaic 

program guide comprising: means for receiving an input signal and generating a coded bit 
stream; a de-multiplexer adapted to receive the coded bit stream and adapted to generate a 
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A mosaic program guide consists of a combination of different video frames 
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coded video bit stream; a video decoder adapted to select I frame data from the coded 
video bit stream and decode and generate a sequence of I frames. 

A fourth aspect of the present invention is a receiver for generating a mosaic 
program guide comprising: a first tuner and demodulator adapted to receive an input signal 
5 and adapted to generate a first coded bit stream; a first a de-multiplexer adapted to receive 
the first coded bit stream and adapted to generate a first coded video bit stream; a first 
video decoder adapted to receive the first coded video bit stream and generate a sequence 
of video frames from a single program; a second tuner and demodulator adapted to receive 
the input signal and adapted to generate a second coded bit stream; a second a de- 

1 0 multiplexer adapted to receive the second coded bit stream and adapted to generate a 

second coded video bit stream; and a second video decoder adapted to select I frame data 
from the second coded video bit stream and decode and generate a sequence of I frames. 

The features of the invention are set forth in the appended claims. The invention 
itself, however, will be best understood by reference to the following detailed description 

15 of an illustrative embodiment when read in conjunction with the accompanying drawings, 
wherein: 

FIG. 1 is an illustration of a display device displaying a mosaic program guide 
according to the present invention; 

FIG. 2 is an illustration of a display device displaying a mosaic program guide and 
2 0 a main program according to the present invention; 

FIG. 3 is a diagram illustrating video a typical sequence of video frames that are 
encoded into a digital data stream; 

FIG. 4 is a schematic block diagram of a receiver for generating a mosaic program 
guide according to the present invention; 

2 5 FIG. 5 is a flowchart illustrating the method steps for generating a mosaic program 

guide according to the present invention; 

FIG. 6A is a schematic block diagram of a first application of the present invention; 

FIG. 6B is a schematic block diagram of a second application of the present 
invention; and 

3 0 FIG. 6C is a schematic block diagram of a third application of the present 

invention. 
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The term frame is interchangeable with the term picture when used in the context of 
video images. The term I frame (intra frame) is defined as a frame of video that is coded 
using prediction only from decoded samples within the same frame. The term P frame 
(predictive frame) is defined as a frame of video data coded using inter prediction from 
5 previously decoded reference frames, using motion vectors. The term B frame (bi- 
directional predictive frame) is defined as a frame coded using multiple inter prediction 
blocks. A block is an N x M array of samples or transform coefficients. A program guide 
is defined as a mosaic of scaled frames from different programs arranged in a pattern. 
Scaling is defined as a process of modifying a video frame to change relationship between 

1 0 the number of display device pixels and the number of pixels of a video frame, according 
to an algorithm, using all or a subset of the pixels of the video. 

FIG. 1 is an illustration of a display device displaying a mosaic program guide 
according to the present invention. In FIG. 1, a display device 100 includes a screen 105 
subdivided into mosaic windows 1 10A, 1 10B, 1 10C, 1 10D, 1 10E and 1 10F. In one 

1 5 example, display device 100 is a television monitor. In a second example, display device 
100 is a projector projecting mosaic windows 1 10A through 1 10F onto screen 105. Within 
each mosaic window 1 10A through 1 10F a corresponding different mosaic image 1 
through 6 is displayed. Each mosaic image 1 through 6 is, for example, a video frame 
from a different program. Mosaic images 1 through 6 may be updated periodically. 

2 0 Mosaic images 1 through 6 may be considered as constituting a program guide of six 

programs, allowing a viewer to sample the six programs before deciding which program to 
view. While six mosaic images are illustrated, any number of mosaic images in any 
geometric arrangement of windows may be displayed. 

FIG. 2 is an illustration of a display device displaying a mosaic program guide and 

2 5 a main program according to the present invention. In FIG. 2, window 105 of display 

device 100 is subdivided into mosaic windows 1 10A, 1 10B, 1 10C and main window 115. 
Mosaic windows 1 10A through 1 10C display mosaic images 1 through 3, respectively. 
Mosaic images 1 through 3 are video frames from different programs. Main window 115 
displays a main program image, which is, at any instant of time, a video frame of a 

3 0 program being viewed. The main program image is refreshed at normal rates and is 

accompanied by corresponding audio. Generally, the mosaic images 1 through 3 are 
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refreshed at a slower than normal rate. While three mosaic images are illustrated, any 
number of mosaic images in any geometric arrangement of windows may be displayed. 

FIG. 3 is a diagram illustrating a typical sequence of video frames that are encoded 
into a digital data stream. A digital data stream, such as the transport stream of the motion 
5 pictures experts group (MPEG) is comprised of digital data (along with other data, such as 
audio data) representing a temporal sequence of video frames of different types. Only the 
video frame sequence is illustrated in FIG. 3. In FIG. 3, a portion of a temporal sequence 
of video frames 120 includes I frames 125, P frames 130 and B frames 135. Each program 
in a transport stream includes its own I, P, and B frames. The main program image 

10 displayed in window 115 of FIG. 2 requires the decoding and presentation of all I frames 

125, P frames 130 and B frames 135 belonging to a single program (i. e the main program). 
Mosaic images displayed in mosaic windows 1 10A through 1 10F of FIG. 1 and mosaic 
windows 1 10A through 1 10C of FIG. 2 are decoded and presented I frames 125 from 
different programs. I frames are used because they do not require decoding of any other 

15 frames in order to have a complete frame. Further, the amount of decoding required is less 
since I frames are not compressed as much as P or B frames. Therefore, in the present 
invention, the mosaic images are generated in the receiver and not by the service or content 
provider and are not complete video programs but samples. 

FIG. 4 is a schematic block diagram of a receiver for generating a mosaic program 

2 0 guide according to the present invention. In FIG. 4, receiver 140 includes a tuner and 

demodulator 145, a de-multiplexer and decryptor 150, an audio decoder 155 and a video 
decoder 165. Tuner and demodulator 145 receives an input signal 170 and generates a 
coded bit stream 1 75 (for MPEG a transport stream). De-multiplexer and decryptor 1 50 
receives code bit stream 175 and generates a coded audio bit stream 180 (for MPEG an 

2 5 audio elementary stream) and a coded video bit stream 185 (for MPEG, a video elementary 

stream). Audio decoder 155 receives coded audio bit stream 180 and generates a playable 
audio out signal 190. 

Video decoder 165 includes a program selector 160, a video bit buffer 195, a 
variable length decoder (VLD) 200, an inverse quantizer 205, an inverse discrete cosine 

3 0 transformer (IDCT) 210, a reconstructor 21 5, a window composer 220, a motion 

compensator 225, an anchor frame storeage 230 and a video controller 235. VLD 200 
further includes a frame detector 240. Coded video bit stream 1 85 passes through program 
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selector 160 and into video bit buffer 195. Program selector 160 allows selection of 
specified channels. Video bit buffer 195 prevents overloading video decoder 165. 

For normal operation (i. e. playing a main program), video controller 235 selects 
programs via a program select signal 245 and video bit buffer 1 95 receives coded video bit 
5 stream 1 85, and passes the coded video bit stream in temporally buffered bursts of data to 
VLD 200. VLD 200, along with inverse quantizer 205 and IDCT 210 generate pixel data 
250 (either an I frame in the case of an I frame or pixel by pixel prediction errors in the 
case of P frames or B frames) degraded by quantization. VLD 200 also generates motion 
vectors 255 which are received by motion compensator 225 which generates motion 

10 compensated predicted pixels 260 from motion vectors 255 and pixels in anchor window 
composer 230. Reconstructor 2 1 5 combines pixel data 250 and motion compensated 
predicted pixels 260 into reconstructed pixels 265. Reconstructed pixels 265 are passed to 
window composer 220 and anchor window composer 230. Window composer 220 
composes reconstructed pixels 265 for display and generates a displayed video out signal 

15 270. In normal mode, window composer 220 simply generates one "full screen" window 
and fills the display space with one frame (at a time). 

For mosaic operation (i. e. displaying a program guide as illustrated in FIG. 5), 
video controller 235 selects channels via channel select signal 245 and video bit buffer 195 
receives coded video bit stream 185, and passes the coded video bit stream in temporally 

2 0 buffered bursts of data to VLD 200. When frame detector 240 detects an I-frame video, 
controller 235 sends a mosaic mode signal 275 A to motion compensator 225 to turn 
motion compensation off, a mosaic mode signal 275B to anchor frames storage to disable 
receiving reconstructed pixels 265 and mosaic mode signal 275C to window composer 220 
to place the window composer in mosaic mode (e. g. scale I frames and place I frames into 

2 5 multiple windows). When frame detector 240 detects a P frame or B frame, video 

controller 235 instructs VLD 200 to ignore the frame and no data is passed out of the VLD. 
Thus, pixel data 250 will contain only I frames. In mosaic mode, window composer 220 
scales each frame of a different program to fill one mosaic window, assembles the 
windows into a mosaic frame and presents the mosaic frame to the video display device. 

3 0 Window composer 220 stores each I frame and replaces older I-frames from each program 

with newer I frames from each program so the mosaic frame is constantly updated. Thus, 
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the mosaic frame is used to refresh the display device, while the mosaic frame itself is 
updated as new I frames are received. 

Video decoder 165 can operate in mixed mode (as illustrated in FIG, 2) by allowing 
decoding of P frames and B frames of a selected program while blocking decoding of P 
5 frames and B frames of all other programs, and appropriate switching of mosaic mode 

control signals 275 A, 275B and 275C. In mixed mode, window composer 220 scales each 
frame of a different program to fill one mosaic window and scales the fully decoded video 
program to fit into a main window. 

FIG. 5 is a flowchart illustrating the method steps for generating a mosaic program 

10 guide according to the present invention. In step 280, the receiver is enabled and an input 
signal is received. In step 285 the receiver is set to mosaic mode and programs to include 
in the mosaic program guide are selected. In step 290, the input signal is de-multiplexed 
(and decrypted if necessary) into an elementary video stream. In step 295, it is determined 
if an I-frame has been detected, and if so, if the detected I frame belongs to a program 

15 selected for display in the video guide. If the detected frame is not an I-frame (for example 
a P frame or a B frame), or is an I frame from a non-selected program, then the method 
loops back to step 290. If the detected frame is an I frame from a selected program then in 
step 300 the I frame is decoded. Next in step 305, each program's last decoded and stored 
I frame is replaced with each program's latest decoded I frame and the mosaic frame is 

2 0 updated. In step 310, the mosaic frame is displayed and refreshed as required. The 
method continuously loops back to step 290. 

FIG. 6A is a schematic block diagram of a first application of the present invention. 
In FIG. 6A, a receiver 350 includes a broadband modem 355 (or a standard modem), a de- 
multiplexer and decryptor 360, a video decoder 365, an audio decoder 370 and a receiver 

2 5 controller 375. Video decoder 365 is identical to video decoder 165 illustrated in FIG. 4 

and described supra. De-multiplexer 360 receives a broadband coded bit signal from 
broadband modem 355, and in response to control signal 3 80 A selects which broad band 
signals to compose into video elementary stream 385 and audio elementary stream 390. 
Audio decoder 370 receives audio elementary stream 390 and generates a playable audio 

3 0 out signal. Video decoder 365 receives video elementary stream 385 and in response to a 

control signal 380B generates a series of decoded I frames for display. 
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FIG. 6B is a schematic block diagram of a second application of the present 
invention. In FIG. 6B, a receiver 395 is similar to receiver 350 illustrated in FIG. 6A 
except broadband modem 355 (see FIG. 6 A) is replaced with a radio frequency (RF) tuner 
and demodulator (or simply an RF tuner) 400 which generates coded bit stream (for 
5 MPEG, a transport stream) and de-multiplexer and decryptor and decryptor 360 is replaced 
with de-multiplexer and decryptor 360A. De-multiplexer and decryptor 360A need not .,.- 
have the capacity of de-multiplexer and decryptor 360 because a control signal 380C is 
provided from receiver controller 375 to select output from tuner and demodulator 400. 
Video decoder 365 receives video elementary stream 385 and in response to a control 

10 signal 380B generates a series of decoded I frames for display. 

FIG. 6C is a schematic block diagram of a third application of the present 
invention. In FIG. 6A, a receiver 405 includes first and second RF tuner and demodulators 
41 OA and 41 0B, first and second de-multiplexers and decryptor 41 5 A and 415B, a first 
video decoder 420, a video decoder 425, an audio decoder 430, a receiver controller 435 

15 and a mixer 440. First video decoder 420 is identical to video decoder 165 illustrated in 
FIG. 4 and described supra. Second video decoder 425 is similar to video decoder 165 
illustrated in FIG. 4 and described supra except that the second video decoder need not 
contain a motion compensator or anchor frame storage and the decoder may be modified to 
recognize and decode only I-frames. First and second tuner and demodulators may or may 

2 0 not be identical and first and second de-multiplexers and decryptor 41 5 A and 415B may or 
may not be identical 

In operation first tuner and demodulator 41 OA, first de-multiplexer and decryptor 
41 5 A, and first video decoder 420 together generate and present all video frames of a main 
program to mixer 440. Second tuner and demodulator 41 0B, second de-multiplexer and 

2 5 decryptor 41 5B, and second video decoder 425 together generate and present all I frames 

of a selected program guide (mosaic) programs to mixer 440. Mixer 440 then scales each 
mosaic frame and main frame to fit corresponding windows with a single frame, assembles 
the scaled frames into a single displayable frame. 

Receiver 405 can also produce normal video and mosaic only mode video via 

3 0 appropriately applied control signals 445A, 445B, 445C, 445D, 445E, 445F and 445G. 

The present invention is applicable to all digital communications standards using I frames, 
P frames and B frames, including but not limited to MPEG-1, MPEG-2, MPEG-4, MPEG- 
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7, International telecommunications Union Standardization Sector (ITU-T) H264, digital 
satellite system (DSS) data structures or other standards that share common data stream 
structures with or are built upon the MPEG standard. In the case of ITU-T H264 standard, 
an additional type of frame, an SP frame is allowed. SP frames are ignored, similarly to P 
5 frames and B frames when the invention is in mosaic or program guide mode. 

The description of the embodiments of the present invention is given above for .the. 
understanding of the present invention. It will be understood that the invention is not 
limited to the particular embodiments described herein, but is capable of various 
modifications, rearrangements and substitutions as will now become apparent to those 
1 0 skilled in the art without departing from the scope of the invention. Therefore, it is 

intended that the following claims cover all such modifications and changes as fall within 
the true spirit and scope of the invention. 



